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FOREWORD 


This  report  presents  a  plan  designed  to  provide  the  Navy  with  the 
in-house  capability  for  ensuring  adequate  and  cost  effective  readiness 
in  all  its  advanced  technology  programs.  The  plan  provides  an  evolutionary 
and  systematic  growth  to  the  highest  payoff  capability  over  a  four  year 
timeframe.  It  Involves  as  a  minimum  technical  admlnlstratlors ,  field 
activity  managers  lead  project  engineers.  Maximum  payoff  requires  the 
development  and  maintenance  of  a  strong  in-house  readiness  technical  base 
located  at  the  laboratory  level  which  is  functionally  oriented  along  major 
weapon  subsystem  lines  (i.e.,  airframe,  power  plant,  avionics  and  armament). 
Until  the  technology  base  concept  is  fully  developed,  validated  and  Implemented 
across  all  AIR  03  technologies,  increased  awareness,  the  wider  ..and  more 
Intensive  application  of  present  assurance  disciplines  augmented  with  available 
quantitative  analysis  methods  are  recommended  as  the  primary  vehicle  for 
assuring  readiness.  The  concepts  recommended  in  this  plan  were  developed 
through  a  qualitative  assessment  of  the  present  acquisition  and  management 
methods  used  to  assure  readiness.  Several  on  going  and  historic  technology 
programs  were  used  in  the  study.  Both  in-house  and  Industry  perspectives 
were  considered. 
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SECTION  I 


EXECUTIVE  SUMMARY 


1.1  INTRODUCTION 

The  AIR  03  Readiness  Assurance  Program  was  initiated  at  NADC  in 
December  1975  by  AIR  03.  The  program  objective  was  to  develop  and 
Implement  a  plan  for  assuring  that  adequate  and  economic  readiness 
would  result  for  future  Naval  airborne  and  shipboard  weapon  system 
designs  conceived  and  developed  by  AIR  03.  Both  AIR  03  and  NADC 
believe  this  objective  can  be  accomplished  by  (1)  injecting  readiness 
considerations  into  6.2  and  6.3  technologies,  (2)  increasing  the  trans¬ 
ition  rate  of  technologies  with  b^llt  in  readiness  to  6.4.,  (3)  Identifying 
high-pavoff  readiness  related  technologies  for  application  to  current 
71eet  problems. 

For  the  purposes  of  this  study,  the  type  of  readiness  being 
assured  was  assumed  to  be  material  readiness.  It  is  defined  in 
OPNAVINST  5444. 4C.  Material  readiness  is  measured  and  reported  by 
the  Navy’s  3-M  data  system  and  is  considered  by  many  including  CNO 
to  be  one  of  the  most  serious  problems  in  the  fleet  today.  It  is  a 
comp lex, extremely  interactive  function  of  R&M,  ILS,  utilization  and 
the  constraints  imposed  by  the  operating  environments. 

A  three  phase  program  was  developed  by  NADC  in  support  of  the 
AIR  03  objective.  Phase  I  (Dec  75  -  Jan  79)  was  a  low  level  quick 
reaction  survey  of  selected  AIR  03  technologies  designed  to  define 
the  broad  readiness  assurance  problems  and  issues.  Phase  II  (Mar 
76  -  Mar  77)  was  a  slightly  larger  effort  designed  to  develop  the 
technical  approach  for  overcommlng  the  problems  of  Phase  I.  All 
approved  initiative  in  the  approach  will  be  developed,  refined  and 
validated  in  Phase  III  using  several  AIR  03  technologies  as  a  test 
bed.  Phase  III  is  expected  to  take  several  years  to  complete.  When 
finished  it  should  result  in  a  proven  readiness  assurance  program 
which  clearly  meets  the  need  and  is  ready  for  institutionalization 
across  all  AIR  03  technologies. 
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This  report  summarizes  the  approach  resulting  from  Phase  II  effort. 
The  resources  and  schedules  for  implementing  Phase  II  recommendations 
are  also  presented. 

Salient  conclusions  irfiich  emerged  from  Phase  I  and  provided  the 
basis  for  initiating  Phase  II  Included  the  following: 

a.  There  is  a  need  for  a  roadmap  or  systematic  set  of  events 
ror  designing  readiness  into  6.2  and  6.3  designs  analogus 
and  effective  as  those  used  to  achieve  performance. 

b.  There  is  a  need  for  a  concise  and  understandable  readiness 
awareness  program  for  TAs  (technical  administrators)  in 
NAVAIR  and  PEs  (project  engineers)  in  the  laboratories 

to  initially  earn  and  update  on  a  reci'rring  basis  the 
status  of  fleet  readiness,  successful  readiness  assurance 
methods  and  effective  management  methods, 

c.  There  is  a  need  for  a  greater  degree  of  quantification  in 
the  readiness  disciplines  in  order  to  enhance  marketing 
positions.  Identify  high  payoff  technologies  and  single 

out  potential  problems  with  sufficient  lead  time  to  effectively 
deal  with  the  problem. 


-2- 


1.2  APPROACH 

1. 2. 1  Roadmap  Development  -  The  approach  used  was  to  initially  constiruct  a  baseline 
of  the  6. 2  and  6. 3  readiness  acq4isltion  process  and  then  develop  a  set  of  interactive 
improvements  based  on  inputs  from  both  industry  and  government.  Information  sources 
used  to  construct  the  baseline  and  develop  the  improvements  consisted  of  the  following: 

a)  DoD  Military  Specifications.  A  list  of  each  reviewed  by  this  study  is 
presented  in  Figure  1. 

b)  Discussions  with  lead  R6M  system  engineers  from  Hazeltine,  Singer,  and 
ITT. 

c)  Discussions  with  Air  340,  Air  360,  and  Air  370  TAs  and  their  lead  tech¬ 
nologists. 

d)  Discussions  with  lead  project  engineers  at  NADC  on  LAMPS,  ASCL,  JTIDS 
and  AIDS. 

e)  Technical  articles  on  R&M  assurance.  A  list  of  some  of  the  more  relevant 
articles  reviewed  by  this  study  is  presented  in  Figure  2. 

f)  Navy  procurements  on  similar  operational  equipments  to  JTIDS  and  ASCL. 

A  list  of  each  reviewed  by  this  study  is  presented  in  Figure  3. 

1. 2. 2  Readiness  Awareness  Syllabus  Development  -  The  approach  used  was  to  develop 
a  set  of  core  courses  which  provided  a  common  understanding  of  readiness  related 
terminology  and  principles,  illustrated  the  impact  of  readiness  design  decisions  in  6. 2 
and  6. 3  downstream  through  example  and  finally  conveyed  the  philosophy  of  the  new 
readiness  assurance  roadmap.  Two  separate  courses  were  developed  for  TAs  and  PEs 
because  of  the  vast  differences  in  the  day-to-day  Involvement  necessary  to  implement 
the  roadmap. 

1. 2. 3  Quantitative  Methods  Expansion  -  The  approach  used  was  to  select  a  readiness 

related  parameter  which  could  be  modelled  and  demonstrated  within  the  time  frame  of  the 
study  as  a  means  of  extending  the  existing  quantification  capabilities  of  Air  03.  Life 
cycle  cost  was  chosen  as  the  study  parameter  _  luse  it  met  the  above 

criteria,  but  also  because  it  was  usable  by  all  Air  03  technologists,  and  it 
^enerallv  exhibits  a  sensitivity  between  good  and  poor  designs  and  it  is  easily 
u-derstood. 
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mtt.ttary  specifications  considered  in  the  development 
OF  A  READINESS  ASSURANCE  ROADMAP 


Reference  Number 


1.  NAVORD  OP  39223 

2 .  AR-lOA 

3.  MIL-STD-A70 
A.  MIL-STD-883 

5.  MIL-STD-280 

6.  MIL-STD-781 

7 .  MIL-E-5AOO 

8.  MIL-T-5A22 

9.  AR-lOA 

10.  MIL-STD-A71 

11.  MIL-STD-785 

12 .  AR-30 

13.  MIL-STD-DoD 
lA.  MIL-R-275A2 

15.  WS-3250 

16.  NPC-250-1 

17.  MIL-R-26A7A 

18.  MIL-R-27070 

19.  MIL-R-27173 

20.  MIL-R-26A8AA 

21.  MIL-R-55231 

22 .  MIL-R-22256 


Title 


Maintainability  Eng.  Handbook 

Aeronautical  Reqmts 

Malnt.  Pgm  Reqmts 

Test  Methods  &  Procedures  for 
Microelectronics 

Definition  of  Terms  for  Equipment 
Divisions 

Reliability  Tests,  Exponential  Distribution 

Electronic  Equipment,  Aircraft,  General 
Specifications  for 
Testing,  Environmental,  Aircraft 
Electronic,  Equip. 

Maintainability  of  Avionics  Equipment 
and  Systems,  General  Requirements  for 

Maintainability  Demonstration 

Reliability  Program  for  Systems  and 
Equipment  Development  and  Production 

Integrated  Logistics  Support  Requirements 
for  Aeronautical  Systems  and  Equipments 

Reliability  Program  Management  (In  Process) 

Aerospace  Systems  and  Subsystems  (Rev.  "A" 
Proposed) 

Reliability  -  General  Specification 
Reliability  Program  Requirements 
Production  -  Ground  Electronic  Equipment 
Development  •*  Ground  Electronic  Equipment 
Ground  Checkout  Equipment 
Development  —  Systems  and  Subsystems 
Production  Electronic  Equipment 
Design  -  Equipment  and  Systems 


FIGURE  1 
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Reference  Number 

Title 

23. 

MIL-R-22732- 

Shipboard  and  Ground  Electronic  Equipment 

24; 

MIL-STD-781 

Reliability  Test  Procedures 

25. 

MIL-R-22973 

Index  Determination  for  Avionic  Equipment 

'  26. 

MIL-R-26667A 

'^Demonstration  Requirements 

27. 

MIL-STD-441 

Military  Electronic  Equipment 

2d. 

MIL-R-23094  '  ' 

Assurance  for  Prod.  Avionic  Equipment 

29. 

MIL-M-99331 

Quick  Reaction  Capability  Electronic  Equipment 

30. 

Spec.  Bull.  506 

Monitoring 

31. 

MIL-STD-721A 

Definitions 

32. 

WR-41 

Reliability  Evaluation 

33. 

MIL-STD-756A 

'^Procedure  for  Reliability  Prediction 

34. 

MIL-STI)-2  CA 

i 

35. 

MIL-T-152B1 

36. 

USAF  SPEC  BLTN  106A 

/ 

37. 

USAF  SPEC  BLTN  5(1) 

38. 

USAF  SPEC  BLTN  523 

>  Environmental  Factors 

39. 

ASD-TR-61-363 

( 

40. 

MIL-Q-9858  (2) 

41. 

NPC-200-2 

\ 

42 

NPC  200-3 

43. 

DCAS  EX  62-10 

44. 

DoD  HDBK  110 

) 

45. 

NAV-P-1034  App  "A" 

/  Quality  Control 

46. 

MIL-Q-21549A 

47. 

MIL-STD-202B  (3) 

\ 

48. 

MIL-STD-446A 

49. 

MIL-T-4807A 

50. 

MIL-E-4970A 

/ 

51. 

MIL-E-5272C  (1) 

( 

/  Test  Methods 

52. 

MIL-T-5422E  (2) 

53. 

MIL-T-18303 

J 

FIGURE  1  (Cont’d) 
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Reference  Number 


54. 

MIL-STD-439B  (1) 

55. 

MIL-E-4158C 

56. 

MIL-E-5400F 

57. 

MIL-E-8189B  (1) 

38. 

MIL-W-9411A  (2) 

59. 

MIL-E-16400 

60. 

MIL-E-19600A 

61. 

ANA  BLTN  444 

62. 

AD114274 

63. 

AD143556 

64. 

MIL-T-713A  (3) 

65. 

MIL-W-5088B 

66. 

MIL-W-8160  D 

67. 

PD-E-531 

68. 

MIL-D-9310B  (2) 

69. 

MIL-D-9412D 

70. 

MIL-D-26239A 

71. 

MIL-D-703727  (2) 

72. 

MIL-M-26512B 

73. 

MIL-M-23313 

74. 

MIL-M-45765 

75. 

WS-3099-1 

76. 

SCL-4301B 

77. 

MIL-STD-415B 

78. 

MIL-T-945A  (2) 

79. 

MIL-T-18306A  (1) 

80. 

MIL-T-21200  D 

81. 

MIL-T-4860C 

82. 

MIL-T-26046 

83. 

MIL-T-26137 

84. 

MIL-T-27382 

Title 


Test  Methods 


Design 


Wiring 


Data 


Maint  ainabillty 


Test  Equipment 


Training 


FIGURE  1  (Cont'd) 
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Reference  Number 


Title 


85.  MIL-E-6051C 

86.  MIL-I-6161D  (2) 

87.  MIL-I-16919A  (3) 

88.  MIL-I-266002 

89.  PD-R-186 

90.  MIL-P-116011) 

91.  MIL-P-90248 

92.  USAF  Spec.  Bltn  56E 

93.  MCP  71-163 

94.  MIL-STD-803 

95.  MIL-H-22174 

96.  MIL-H-25946 

97.  MIL-H-26207 

98.  ESD  61-99 

99.  MIL-B-5005A  (2) 

100.  MIL-E-171362D 

101.  DoD  INST  4151 

102.  MCP  71-550 

103.  MCP  71-673  . 

104.  PP-SIG-SE-IA 

105.  WR-1 

106.  WR-2 

107 .  MIL-STD-108D 

108.  MIL-C-172C  (D) 

109.  MIL-E-2036C  (4) 

110.  MIL-STD-243 

111.  MIL-1-8700 

112.  MIL-E-25366A 

113.  MIL-STD-167 

114.  MIL-R-18301B 

115.  MIL-R-1836A  (2) 


3 


Training 


Interference 


Preservation  and  Packaging 


Human  Factors 


\  Provisioning 

Enclosures 
Enclosures 
Equipment  Types 
Equipment  Types 
Installation 
Vibration 
Vibration 
Reports 


FIGURE  1  (Cont'd) 
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Reference  Number 

Title 

116. 

UIL-T-9107  (2) 

Test  Report 

117. 

118. 

119. 

120. 

MIL-STD-105C 

MIL-STD-414 

DoD  HDBK-106 

DoD  HDBK-108 

Test  Report 

] 

121. 

MIL-M-23313 

Maintainability  Requirements  for  Shipboard  and 
Shore  Electronic  Equipment  and  Systems 

122. 

MIL-M-26512B 

Maintainability  Requirements  for  Aerospace  and 
Equipment 

123. 

WR-30 

Weapon  Readiness  Achievement  Program 

124. 

MIL-M-26512B 

Maintainability  Test  and  Demonstration 

Requirements  for  Systems  and  Equipment 

125. 

MIL-M-26512B 

Maintainability  Verification  of  Predictions  for 
Systems  and  Equipment 

126. 

MIL-M-9933  (1) 

Maintainability  and  Reliability  Program-Quick 
Reaction  Capability  Electronic  Equipment 

127. 

MIL-STD-829 

Terms  and  Definitons  for  Maintainability 

128. 

WS-3099-1 

Maintainability  General  Specification 

129. 

MIL-STD-778 

Definitions  for  Maintainability  Engineering  (Crop) 

130. 

SCL-4301B 

Maintainability  Design 

FIGURE  1  (Cont'd) 


TECHNICAL  ARTICLES  CONSIDERED  IN  THE 
DEVELOPMENT  OF  A  READINESs" 
ASSURANCE  ROADMAP 


Title 

Author 

Source 

1.  Electronics  X 

Howard  Gates 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  76 

2.  Avionics  Reliability  Stucfy 

L/C.  Ben  Swett 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  75 

3,  F-15  Reliability  Pgm  Mgt 

Gene  Kunznick 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  75 

4.  Industiy  Viewpoints  on  the 
Achievement  of  Reliability 
Requirements 

James  Tamsen 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  75 

5.  Improving  the  Cost  Effec¬ 
tiveness  of  Military 
Specifications  and  Stds. 

LaMonte  Brown 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  75 

6.  Operational  Influences  on 
Reliability 

George  Kem 

Final  Report  of  the  Joint 
Logistics  Commanders 
Electronic  System  Reli¬ 
ability  Workshop  1  Oct  75 

7.  Long  Life  Assurance  Study 
for  Manned  Spacecraft 

R.W.  Burrows 

Martin  Marietta  Corp 

Dec  1972 

8.  A  Comparison  of  Demon¬ 
strated  and  Achieved 
Equipment  Maintainability 

Philco-Ford 

IEEE  R&M  Sjrmposium 

Jan  1974 

9.  Forcing  Functions  Integrate 
R&M  into  Design 

E.G.  Metzler 

IEEE  R&M  Symposium 

Jan  1974 

10.  Practical  R&M  Design 
Techniques 

GTE  Sylvanla 

IEEE  R&M  Symposium 

Jan  1974 

Figure  2 
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TECHNICAL  ARTICLES  USED  IN  THE 
DEVELOPMENT  OF  A  READINESS 
ASSURANCE  ROADMAP 
(Continued) 


Title 

Author 

Source 

11.  Reliability  Testing  Pitfalls 

E.  F.  Thomas 
(General  Dynamics) 

IEEE  R&M  Symposium 

Jan  1974 

12.  Reliability  and  Choosing 
the  Number  of  Prototypes 

Dept,  of  Army 

IEEE  R&M  Symposium 

Jan  1974 

13.  Application  of  Life  Cycle 
Costing  to  the  DoD  System 
Acquisition  Decision 
Process 

Jacques  Gansler 

IEEE  R&M  Symposium 

Jan  1974 

14.  Reliability  Demonstration 
Testing  Using  Failure 

From  Trials 

Rockwell 

International 

IEEE  R&M  Symposium 

Jan  1974 

15.  Estimating  Life 

Parameters  from  Bum 

In  Data 

U.  S.  Army 

IEEE  R&M  Symposium 

Jan  1974 

16.  Equipment  Procured 
Reliability  and  Real  Life 
Survival 

Oscar  Markowitz 

IEEE  R&M  Symposium 

Jan  1974 

17.  Accurate  LCC  Estimating 
Early  in  Program  Develop¬ 
ment 

Martin  Marietta 

IEEE  R&M  Sjrmposium 

Jan  1974 

Figure  2 
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PROCUREMENTS  REVIEWED  IN  THE 
DEVELOPMENT  OF  A  READINESS 
ASSURANCE  ROADMAP 


Nomenclature 

Functional  Description 

1. 

AN/ARR-52 

Radio  Receiving  Set 

2. 

AN/ARR-72 

Sonar  Radio  Receiving  Set 

3. 

AN/ARR-76 

Sonobuoy  Receiver 

4. 

R-1047 

On  Top  Position  Indicator 

5. 

AN/ARN-52 

Tacan  Set 

6. 

AN/ARN-21 

Tacan  Set 

7. 

AN/ASQ-19 

Integrated  Electronic  Control 

8. 

AN/APX-76 

Interrogator  Set  (IFF) 

9. 

AN/APX-72 

Transponder  Set  (IFF) 

10. 

AN/ASW-25 

Digital  Data  Communications  Link 

11. 

AN/ARR-69 

UHF  Auxiliary  Receiver 

12. 

AN/ARA-50 

Direction  Finder 

13.  j 

AN/APX-64 

Transponder  Set  (IFF) 

Figure  3 
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1.3 


SUMMARY  OF  RESULTS 


1.3.1  Roadmap  Development 

1.  3. 1. 1  Based  on  a  review  of  the  present  readiness  assurance  methods  the  follow¬ 
ing  conclusions  were  made: 

A.  Present  methods  contain  serious  deficiencies  in  nearly  all  phases  of  the 
assurance  process.  Included  are:  conceptual  design;  speclflca^!i.on 
development;  DID  design  for  RFP  R&M  design  approach  and  ADM  mon¬ 
itoring  framework;  RFP  source  selection;  ADM  monitoring  and  ADM 
transitioning. 

B.  The  result  of  these  deficiencies  contribute  to  an  average  reliability 
degradation  between  original  specification  and  field  performance  of 
6.5^1)  with  a  range  between  4.  and  9.  They  also  contribute  to  a  near 
zero  treatment  of  maintainability  and  supportablllty  issues  prior  to  and 
during  ADM.  This  lack  of  emphasis  causes  the  Navy  to  pay  enormous 
sums  during  full  scale  development  for  quick  reaction  support  systems 
involving  interface  units,  ATE,  TPS  programs  and  special  CETS/NETS 
in  order  to  RFI  units  after  they  are  pulled  from  an  aircraft.  The  com¬ 
bination  of  lower  than  expected  reliability  and  jury  rigged  support 
systems  usually  results  in  both  low  readiness  and  very  expensive 
operating  costs  as  well  as  continued  get  well  programs  which  are  also 
expensive.  Marginal  conceptual  design  work  prior  to  ADM  also  con¬ 
tributes  to  the  fleet  readiness  problem  by  not  allowing  the  proper 
attention  to  be  focused  on  critical  technologies  which  could  benefit  from 
a  push  for  either  initiation  purposes  or  momentum  continuation. 

C.  Vendors  are  capable  of  developing  designs  with  higher  reliability  and 
better  testability,  repairabillty,  environmental  durability  and  trans¬ 
portability  than  they  are  currently  doing  for  the  government.  Factors 
cited  which  limit  these  benefits  are  existing  environmental  control 
systems  from  the  intended  aircraft  platforms,  component  cechnologies 
available  at  or  prior  to  ADM  contracting,  and/or  unit  cost  constraints 
imposed  by  the  government.  The  Navy  however,  never  learns  how  much 
better  a  design  they  can  get  beyond  the  single  point  performance 

unit  cost  design  requested  by  the  RFP  because  It  never  asks  for  them. 


Notes; 

1.  Based  on  values  developed  by  NADC  to  explain  differences  between  Mil  781  environ¬ 
mental  and  field  as  reported  in  Col.  Swetts  article  "The  Avionics  Reliability  Study." 

2.  Based  on  an  NADC  reliability  study  for  tactical  communications  systems  and  sono- 
buoy  receivers  reported  in  Table  I  of  Section  6  of  this  report. 
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Under  these  procurement  practices,  the  vendor  Is  not  even  slightly  motivated  to 
respond.  Bv  revising  present  procurement  practices,  the  government  could  increase 
the  opportuinitv  for  developing  designs  which  have  a  tremendous  payoff  downstream 
in  terms  of  reduced  demands  for  critical  fleet  resources  such  as  maintenance 
personnel,  0M6W  dollars  and  vessel  space.  Figures  four  and  five  illustrate  the 
wide  range  in  reliability  gains  which  can  be  realized  with  typical  avionics  systems. 
For  example,  if  a  new  system  is  intended  to  replace  an  existing  fifteen  years  later 
without  anv  increase  in  performance  levels,  figure  four  indicates  that  component 
technologies  alone  could  result  in  reliability  gains  between  8  and  16  depending  on 
whether  a  unit  cost  constraint  was  imposed.  If,  however,  performance  levels  were 
allowed  to  Increase  at  historic  growth  rates.  Figure  five  Indicates  that  component 
reliability  gains  are  generally  cancelled  out  resulting  in  a  unity  system  reliability 
gain.  Clearly  a  new  design  with  less  than  historic  performace  growth  will  result 
in  a  reliability  payoff. 

D.  Naw  managers  could  make  more  readiness  enhancing  design  decisions  if  they  fully 

appreciated  the  impact  of  design  decisions  dovmstream.  This  forward  looking  vision 
can  in  part  be  accomplished  through  training.  By  and  large,  however,  it  is  ac¬ 
complished  with  credible  RdM/ILS  readiness/LCC  prediction  techniques.  Up  to  now 
there  was  an  excvise  for  not  making  sacrifices  in  ADM  for  the  purposes  of  readiness 
and  cost  because  (a)  it  was  believed  no  single  technology  could  Impact  readiness 
on  a  complex  weapon  system  and  (b)  believable  and  accepted  operating  cost  factors 
were  not  available.  Presently  the  Navy  is  capable  of  (a)  relating  and  ILS 
design  factors  to  readiness  in  both  an  economic  and  timely  manner  using  NADC's  PRISM 
simulator  for  fast  Impact  assessments  and  (b)  providing  realistic  operating  cost 
factors  through  the  Naw’s  maintenance  cost  subsystem  at  NADC.  This  data  bank  is 
updated  annuallv  bv  the  NALCOMIS  proiect  office  in  NAVAIR  (PMA-270).  With  both 
capabilities  the  Na'/v  can  now  fully  iudge  the  operational  impact  of  new  designs. 

To  fullv  exploit  this  capability,  readiness  oriented  designs  must  be  encouraged 
from  industry. 

R.  Some  degree  of  check  and  balance  system  is  required  of  Industry  if  readiness  is  to 
be  assured.  Tlie  Nav7  has  to  be  extremely  careful  of  underlying  assttmptions  con¬ 
cerning  a  design  before  it  fully  accepts  and  uses  operational  performance  character¬ 
istics'  in  its  readiness  and  costing  tradeoff  considerations.  Ass'jmptions  which  can 
be  extremely  critical  include  parts  selection,  environmental  conditions,  and  tech¬ 
nology  breakthroughs. 

1.3. 1.2  A  new  6. 2-6. 3  roadm.ap  was  deyeloped  which  fully  overcomes  the  deficiencies  cited 
bv  means  of  the  following  special  features; 

A.  Complete  Readiness  Design  Approach  by  the  Naw  Prior  to  Preparation  of  AIM 

specifications  -  The  design  will  be  based  on  technology  forecasts  for  components, 

ECS,  architecture,  and  test  methods,  as  well  as  the  logistics  and  operating  environ¬ 
ments.  Tlie  design  will  be  used  to  develop  realistic  R,  M,  unit  cost  and  operation 
cost  design  goals  for  inclusion  in  the  RFP.  It  will  also  be  used  to  Investigate 
critical  readiness  related  technology  Issues  in  the  event  projected  system  readiness 
in  the  RFP  but  will  be  updated  periodically  and  serve  as  a  reference  point  in 
evaluating  industry’s  responses. 
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ARC  34/37 - ?  ULTRA  HIGH  1955-1967  (VHP  RADIO) 

REL  UNLIMITED 

PROD  COST  (6  TIMES  UNIT  COST  OF  2) 


COMPONENTS  HAVE  guy.  DEMANDS  FOR  MORE  PERFORMANCE 
\EMdRE  RELIABLE  =*  HAVE  INCREASED  RADAR  COMPLEXITY 


OUR  MORE  RELIABLE  COMPONENTS 


1.  3.1.3 


B. 


C. 


D. 


E. 


Complete  Vendor  Readiness  Design  Approach  in  ADM  HFP  -  The  vendor 
will  be  required  to  provide  inputs  which  describe  his  complete  main¬ 
tenance/support  system  along  with  his  estimates  for  the  cost  of  each. 

He  will  also  be  required  to  justify  the  rationale  for  the  selection  of  his 
design  and  also  provide  inputs  on  selected  critical  issues.  He  will  also 
be  required  to  submit  a  sensitivity  analysis  demonstrating  how  his 
recommended  maintenance/support  system  and  its  costs  vary  with 
+100%  and  -50%  changes  in  reliability,  and  significant  variations  to 

^ADM^Mo^tort^  Framework  -  Data  for  performing  the  independent 
assessment  along  with  the  timeframe  and  format  will  be  part  of  the  RFP 
for  pricing  and  become  part  of  the  s^ed  contract. 


Validation  of  Vendors  Readiness  Design  Approach  -  All  facets  of  the 
design  including  R&M  technology  projections,  cost  factors  will  be  verified 
against  the  baseline  Navy  design.  Major  discrepancies  will  be  investi¬ 
gated  by  the  Navy  for  uniqueness. 

Selection  of  an  ADM  Vendor  Using  Readiness  and  Life  Cycle  Costs  in 
Addition  to  Performance 


F .  Independent  Assessment  during  ADM  -  The  Navy  will  project  system 
R&M  of  the  ADM  design  on  a  periodic  basis  and  compare  with  the 
vendors  results.  Serious  differences  will  be  resolved  jointly.  If  they 
cannot,  the  Navy  will  develop  the  most  cost  effective  design  candidates 
to  bring  the  program  back  on  course. 


G.  Maintaining  a  Traceable  Path  through  6. 2  and  6. 3  -  This  documentation 
will  be  used  to  facilitate  the  transition  to  6.4  particularly  in  the  area  of 
incentives  and  for  reference  in  future  developments  with  the  same 
vendor. 


The  actual  rationale  for  each  feature  is  discussed  in  Section  H  of  this  report. 

To  implement  all  aspects  of  the  new  roadmap,  the  Navy  must  develop  and 
retain  a  readiness  technology  base.  Personnel  within  the  base  must  be  1) 
knowledgeable  of  the  engineering  principles  for  the  technology  being  developed, 
2)  be  equipped  with  rapid  and  easy  to  use  technology  prediction  and  design 
assessment  methods  and  3)  capable  of  trading  off  performance  for  readiness. 
The  first  criteria  suggests  that  at  least  four  distinct  bases  must  be  developed 
following  a  vehicle  subsystem  approach  -  i.  e.  airframes,  power  plants, 
avionics,  and  armaments.  Personnel  and  their  technical  tools  within  each 
base  will  probably  develop  along  functional  lines  (ie.  radar  ESM,  computer, 
displays,  etc.)  Initially  as  the  funding  for  specific  readiness  assurance  pro¬ 
grams  will  likely  come  from  individual  Air  03  programs.  Eventually  how¬ 
ever  personnel  in  the  technical  base  will  be  capable  of  supporting  any  function 
in  the  base  equally  well  through  cross  training  provided  the  technical  tools 
have  been  developed  and  maintained. 
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1.3. 1.4 


It  is  estimated  that  a  minimum  of  one  year  will  be  required  to  develop  the 
readiness  technical  base  capable  of  implementing  the  readiness  roadmap 
philosophy  for  a  single  aviation  function.  About  2-1/2  people  will  be  re¬ 
quired  during  this  time  frame  to  develop  the  necessary  data  bases  and 
engineering/analysis  tools.  After  startup,  it  is  estimated  that  1  man  year 
per  year  will  be  required  to  maintain  the  technical  tools  and  1  man  year  per 
year  will  be  required  to  apply  the  developed  capability  to  a  given  program. 
Economies  due  to  commonality  of  up  to  50%,  should  be  realized  in  startup 
costs  for  each  additional  function  developed  in  the  same  technology  base. 

These  economies  should  also  apply  to  the  annual  maintenance  costs  appointed 
with  maintainii^  the  data  base  and  tools  but  not  for  applications. 

1.  3. 1. 5  Partial  implementation  of  the  roadmap  has  merit  and  is  probably  the  best 

way  to  proceed  until  the  full  readiness  technology  base  is  completed.  Through 
the  use  of  a  short  training  program,  project  managers  and  engineers  with 
minimal  skills  in  R&M  and  ILS  techniques  can  be  instructed  to  use  part  2 
(complete  Vendor  design  approach  in  the  ADM  RFP)  and  part  5  (selection  of 
vendor  using  readiness  and  LCC  considerations  in  addition  to  peiformance) 
of  the  roadmap.  The  degree  of  improvement  from  partial  implementation 
over  today's  methods  is  highly  a  function  of  the  quality  of  the  vendor's  inputs. 
With  realistic  inputs  the  Navy  should  realize  tremendous  benefits.  If  the 
vendor  takes  a  license  to  make  brash  assumptions,  partial  implementation 
is  probably  no  better  off  than  today's  methods.  The  mere  possibility  of 
doing  better  than  today's  methods  gives  a  slight  edge  to  partial  implementation. 

1. 3. 1. 6  Implementation  of  roadmap  pairt  7  (independent  assessment)  was  attempted 
in  Phase  n  of  this  study  for  two  designs  already  in  6. 3.  The  effort  was 
purely  exploratory  in  nature.  Its  objective  was  to  gage  the  significance  of 
the  monitoring  framework  and  the  technical  base  in  the  performance  of 
part  7.  The  JTIDS  and  ASCL  programs  were  selected  as  test  cases  for 
the  study.  Neither  had  much  of  a  monitoring  framework  set  up  outside  the 
standard  Navy  3  day  design  reviews.  The  assessment  was  attempted  with 
electrical  engineers  possessing  an  extensive  background  in  roadmap  prin¬ 
ciples,  few  technology  base  tools,  and  only  limited  experience  with  the 
hardware.  The  results  of  their  assessments  are  presented  in  Section  6 
of  this  report.  In  brief,  it  was  found  that  without  the  monitoring  framework 
no  critical  independent  assessment  was  possible  without  payments  for  data 
in  the  neighborhood  of  $120K.  The  only  assessment  which  could  be  accom¬ 
plished  was  a  comparison  of  the  vendor's  prediction  with  the  specification 
in  the  area  of  reli^llity.  Similar  assessments  were  possible  for  organi¬ 
zational  maintainability  in  only  one  of  the  two  cases  considered.  The  second 
one  had  a  prediction  but  no  specification.  Sample  assessments  for  inter- 
mediaie  maintainability  were  not  possible  at  all  as  there  was  no  specification 
or  prediction.  Where  assessments  were  possible,  the  contractors  prediction 
always  equalled  or  exceeded  the  specification,  thereby  indicating  no  problem. 
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1.3.2 
1.3.  2.1 


1.3.  2. 2 


1 .  3. 2.  3 


1.3.3 
1.3.  3.1 


This  conclusion  can  be  extremely  misleading  if  the  vendors  predictions 
were  based  on  a  whole  series  of  incorrect  assumptions  such  as  1)  the  use 
of  gold  parts  instead  of  aluminum  or  2)  the  use  of  an  inhabited  environment 
in  lieu  of  an  uninhabited  environment.  While  no  specific  design  or  assump¬ 
tion  data  was  provided  by  the  vendors,  they  did  give  out  samples  of  what  they 
could  provide.  Based  on  these  inputs  the  two  NADC  engineers  concluded 
that  if  the  vendor  data  were  available,  the  assessment  tools  and  work  around 
methods  characteristic  of  the  technology  base  would  be  required  to  perform 
the  assessment  in  a  timely  manner  to  effect  the  design. 

Awareness  Syllabi 

The  resulting  syllabi  for  TAs  is  a  one  day  course.  It  concentrates  heavily 
on  the  features  of  the  new  roadmap,  the  implementation  requirements  for 
the  readiness  technology  base,  and  the  type  of  problems  which  are  likely 
to  result  from  using  the  full  or  partial  roadmap,  and  the  type  of  options 
available  for  each  class  of  problem.  The  course  is  not  R&M  or  ILS  engineer¬ 
ing  oriented.  Details  are  presented  in  Section  3  of  this  report. 

The  resulting  syllabi  for  PEs  is  a  three  day  course.  The  course  features 
an  in  depth  treatment  of  the  new  roadmap's  methods  as  well  as  the  means  of 
implementing  and  interpreting  each  element.  The  PE  course  deals  with  the 
situations  which  might  occur  at  each  junction  from  both  the  vendor's  and 
readiness  assurance  engineer's  point  of  view.  The  course  also  addresses 
the  options  open  for  each  situation  along  with  the  types  of  factors  which 
should  be  considered  in  making  representative  decisions.  Details  of  the 
course  are  presented  in  Section  4  of  this  report. 

Implementation  Requirements  per  syllabi 

A.  Startup  (1st  year  only) 

a.  preparation  time  -  6  man  months 

b.  Implementation  time  -  2. 5  man  months 

B.  Annual  recurring 

a.  preparation  update  time  -  3  man  months 

b.  implementation  time  -  2. 6  man  months 

Quantitative  Methods  Extension 

A  computerized  costing  model  called  PAYOFF  3  was  developed  for  translating 
design  improvements  in  terms  of  R&M  weight  volume,  and  unit  cost  into  LCC 
savings.  The  payoffs  are  time  phased  in  the  sense  they  are  limited  to  the 
percent  completion  of  the  R&D  program.  Therefore  if  the  R&M  program 
changes  in  length,  funding,  or  expected  design  benefits,  the  IX:C  will  also 
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1.3.  3. 2 

1.  3.  3.3 

1.3.  3. 4 


change.  Weapon  system  planning  data  along  with  their  expected  ADM  and 
R&M  windows  are  inputs  to  the  model.  Baseline  cost  factors  are  also  in¬ 
putted.  These  are  obtained  automatically  from  the  VAMOSC  cost  data  bank 
at  NADC. 

The  model  was  exercised  for  three  Air  03  technologies  to  demonstrate  its 
capabilities.  Technologies  considered  include  light  weight  hydraulics,  ring 
laser  gyro  and  advanced  modular  radar.  The  range  of  aircraft  considered 
for  application  included  VSTOL  A,  F18,  VSTOL  B,  VPX,  OVX,  and  A-18. 
Results  from  PAYOFF  3  for  a  representative  R&D  funding  profile  are  tabu¬ 
lated  in  figure  6. 

A  more  in  depth  description  of  the  model  and  the  three  technologies  con¬ 
sidered  is  presented  in  Section  5  of  this  report. 

bnplementation  Requirements 

A.  1  man  year  per  year  would  be  required  to  operate  and  maintain  the 
model  to  support  all  Air  03  technologies  with  a  reasonable  number  of 
parametric  studies.  This  estimate  assumes  there  are  no  charges 

the  baseline  cost  factors  from  the  VAMOSC  data  bank  and  the  model  is 
run  by  NADC  personnel.  The  estimate  is  location  and  conqjuter  inde¬ 
pendent. 

B.  In  order  for  NAVAIR  personnel  to  access  the  model,  a  detailed  user 
manual  would  have  to  be  written  and  the  model  and  its  data  bases  trans¬ 
ferred  to  NAVAIR's  computer.  This  would  require  about  a  .5  man 
years  of  work  to  complete  on  a  one  shot  basis. 
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TYPICAL  RESULTS  FROM 
PAYOFF  3  FOR  A 
SINGLE  R&D  FUNDING  PROFILE 


Technology 

25  Yr. 
Baseline 
Costs 
$M 

Representative  R&D  Pgm 

$ 

M 

A 

Rel 

A 

Wt 

A 

Maint 

LCC 

$M 

Savings 

$M 

Lt  Wt  Hydraulics 

1023 

17.3 

20% 

-50% 

-10% 

849 

$174 

Ring  Laser  Gyro 

621 

24.6 

900% 

-50% 

+100% 

235 

$386 

Advaiu:ed  Mod  Radar 

615 

28.7 

100% 

-50% 

-50% 

240 

_ 1 

$375 

Figure  6 
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1.4  CONCLUSIONS 


1.4.1  Roadmap  and  Syllabi 

A.  Consistent  cost  effective  readiness  can  not  be  achieved  using  present  6. 2- 
6. 3  acquisition  methods.  A  major  overhaul  across  the  board  is  needed. 

Small  adjustments  to  any  part  alone  will  not  bring  about  improvement 
because  of  the  highly  interactive  nature  of  the  process. 

B.  Readiness  assurance  can  be  realized  through  the  application  of  the  7  readiness 
roadmap  principles  as  they  tend  to  close  the  gap  between  perceived  prob¬ 
lems  in  today's  system  and  an  ideal  check  and  balance  system  between  in¬ 
dustry  and  government. 

C.  The  roadmap  principles  of  specification  selection,  monitoring  and  parallel 
design  are  not  revolutionary  -  they  just  make  good  management  sense.  These 
same  principles  are  applied  on  a  routine  basis  by  technologists  when  they 
acquire  performance. 

D.  The  Navy  can  not  implement  all  of  the  roadmap  concepts  overnight  on  all 
functional  programs  in  Air  03.  They  must  develop  the  necessary  tech¬ 
nology  base  in  terms  of  skills  and  capabilities  before  the  roadmap  can  be 
applied  successfully  and  routinely. 

E.  Until  a  total  technology  base  is  developed  in  airframes,  power  plants, 
avionics,  and  armaments,  the  implementation  of  the  syllabi  has  the  potential 
for  providing  low  cost  immediate  relief  across  all  technologies  by  educating 
TAs  and  PEs  in  the  partial  use  of  readiness  roadmap. 

F.  Partial  roadmap  implementation  with  its  inherent  risks  of  optimistic  vendor 
design  responses  to  the  RFP  appears  to  be  far  superior  than  present  methods 
of  no  design  at  all.  The  Navy  can  minimize  this  risk  somewhat  by  using 
baseline  design  data  on  today's  systems  and  allowing  for  modest  technology 
growth  factors. 

1.4.2  Quantitative  Methods  Extension 

A.  Life  cycle  costs  capability  of  the  PAYOFF  3  has  the  potential  to  aid  pro¬ 
gram  management  to  Investigate  options  from  a  more  rationale  point  of 
view  rather  than  a  speculative  one. 

B.  Care  must  be  taken  to  verify  the  design  goal  payoff  before  use  ol  the  model 
otherwise  erroneous  results  will  occur  and  Navy  may  be  no  better  off  than 
it  was  before  PAYOFF  3. 

C.  Due  to  the  spontaneous  nature  of  management  queries,  the  PAYOFF  3  model 
would  probably  be  of  more  use  to  the  Navy  if  It  were  installed  in  NAVAIR 
rather  than  at  NADC. 
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1.5  RECOMMENDATIONS 

1. 5. 1  Air  03  adopt  a  time  phased  program  to  develop,  test  and  scope  the  roadmap 

implementation  concepts  proposed  with  the  intention  of  full  implementation  on 
all  Air  03  technologies  in  four  years.  The  following  would  constitute  a  minimum 
program  between  now  and  then: 


a)  1st  year 

MY 

1) 

publish  and  distribute  the  7  roadmap  features 
to  all  technologists 

.15 

2) 

implement  TA  and  PE  syllabi 

1.5 

3) 

develop  technology  base  for  a  single  function  in 

7.5 

avionics,  power  plants,  and  airframes. 

9.15 

b)  2- 

4th  years 

1) 

update  and  implement  TA  &  PE  syllabi 

1.0  /yr 

2) 

update  technology  base  &  roadmap  as  required 

3.00/yr 

3) 

apply  full  roadmap  principles  on  three  6. 2  programs 
with  supiHJrt  of  the  technology  base. 

3. 00/yr 

7,oo/yr 

A  maximum  progpram  would  Involve  2  functions  in  each  technology  base  (avionics, 
power  plants,  and  airframes)  instead  of  one  In  the  minimum  case.  Either  pro¬ 
gram  would  provide  some  payoff  to  all  technologies  primarily  through  the  use 
of  the  syllabi.  The  maximum  progjram  would  provide  a  greater  short  term  pny- 
off  during  years  2  through  4  than  the  minimum  (six  6. 2  programs  with  a  techni¬ 
cal  base  support  vice  three)  plus  a  data  base  for  determlnimg  the  full  scale 
implementation  recpirements  based  on  the  benefits  of  functional  commonality 
within  a  technology  base. 

1.  5. 2  Air  03  continue  to  support  the  LCC  benefits  analysis  capability  on  an  annual 
basis  for  its  rapid  easy  to  use  credible  responses  on  critical  program  issues 
such  as  schedule,  cost,  and  payoff. 

1. 5. 3  Air  03  develop  a  roadmap  for  transferring  high  payoff  readiness  technologies  to 
Air  06  for  inclusion  in  today's  systems. 

1. 5. 4  Air  03  develop  strategy  for  pushing  readiness  related  technologies  outside  Air  03 
particularly  in  the  area  of  supportability  so  that  aviation  desigpis  can  be  optimized. 
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SECTION  II 


Alr-fl3  READINESS  ASSURANCE  ROADMAP 
FOR 

AVIONICS  SYSTEMS  IN  6. 2/6. 3 

2.1  Roadmap  Objective 

2.1.1  General 

Provide  a  sequential  set  of  events  (a  traceable  path)  for  assuring  the 
development  of  cost  objective  readiness,  reliability  and  maintainability  into 
AIR-03  Avionics  Systems  from  a  Navy  technical  point  of  view. 

2.1.2  Specific 
Readiness 

o  Prevent  errosion  of  present  fleet  performance  through  RfiM  degradation, 
o  Ensure  adequate  mission  success  rates. 

o  Identify  R&M/ILS/operational  technologies  which  must  be  pushed  to 
ensure  readiness  bojectives. 

Reliability  and  Maintainability 

o  Close  the  gap  between  specified  values  and  fleet  performance. 

o  Improve  the  level  of  fleet  R&M  performance  values. 

o  Ensure  equipment  can  operate  in  the  most  demanding  logistics/ 
operating  environment. 

o  Ensure  that  latest  technologies  are  fully  exploited. 

COST 

o  Minimize  the  cost  of  design,  acquisition,  and  operations  while  insuring 
that  fleet  readiness  requirements  are  met. 

2.1.3  Approach 

The  approach  for  developing  the  required  roadmap  consisted  of  an  assessment 
of  the  present  readiness  milestones  from  both  a  Navy  and  Industry  perspective,  the 
formulation  of  viable  alternatives  and  the  selection  of  a  recommended  method  consider¬ 
ing  effectiveness,  feasibility  and  implementation  costs. 
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Salient  readiness  assurance  milestones 


FIGURE  7 
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22  Salient  Readiness  Assurance  Milestones  -  Present  assurance  milestones 

for  both  NAVAIR  and  field  activity  project  engineers  are  summarized  in  Figure 
5  for  a  typical  advanced  technology. 

2. 3  Technical  Management  Milestones  Assessment 

2.3.1  Milestone  1  -  Readiness  Inputs  to  DCP 

2. 3. 1.1  DEFICIENCY 

Reliability  and  Maintainability  goals  and  requirements  do  not 
necessarily  reflect  the  needs  of  the  fleet,  the  existing  R&M  status  in  the  fleet, 
or  advances  in  technology. 

2. 3. 1.2  PROPOSED  CORRECTIVE  ACTION 

Systematize  the  development  of  R&M  goals  and  requirements  for  the  ADM  DCP. 

o  Insure  that  operational  requirements  for  MTBF  and  MTTR  at  the  "0"  level 
are  considered. 

o  Develop  the  best  possible  representation  of  the  environemnt  to  which 
both  the  ADM  and  the  production  equipments  will  be  exposed. 

o  Incorporate  the  best  estimate  of  the  specification  MTBF  to  fleet  MFHBF 
degradation  factors. 

o  Insure  that  the  Navy  requirements  and  goals  for  R&M  are  provided  to 
AIR-03  along  with  the  anticipated  uses  and  technical  requirements  for 
the  ADM  equipment  developments. 

o  Insure  that  the  latest  technologies  in  R&M  and  ILS  are  considered. 

2. 3. 1.3  IMPLEMENTATION  REQUIREMENTS 

o  Generate  and  maintain  a  data  base  of  the  R&M  parameters  for  existing  AN 
equipments.  Include  cost  elements,  specification  requirements,  test 
plans  and  results,  and  a  history  of  fleet  experience.  Develop  a  data 
base  management  system  to  access  the  information  in  an  economic/timely 
manner  and  pertinent  format. 

o  Generate  and  maintain  a  data  base  of  R&M  and  cost  parameters  pertinent 
to  the  electronic  component  environmental  interface  and  support  tech¬ 
nologies  assembly.  Develop  a  data  base  management  system  to  access  cne 
inf ormation-' in  an  economic  and  timely  manner  and  pertinent  manner. 

o  Generate  and  maintain  a  data  base  of  expected  operating  and  logistics 
envoronments .  Develop  a  data  base  management  system  to  access  the 
information  in  an  economic  and  timely  manner  and  pertinent  format. 

o  Develop  a  comprehensive  methodology  for  the  selection  of  R&M  goals  and 
minimum  acceptable  requirements  for  all  stages  of  development. 
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2.3.2 


Milestone  2  -  Develop  ADM  Specification 


2. 3. 2.1  DEFICIENCY 

ADM  specifications  do  not  necessarily  reflect  realistic  or  complete 
readiness  goals  or  the  expected  logistics /operation  environment. 


2. 3. 2.2  PROPOSED  CORRECTIVE  ACTION 

o  Insure  that  the  R&M  and  DTC  requirements  In  the  DCP  are  included 
in  the  ADM  specification. 

o  Insure  that  the  operating  and  logistics  environment  in  the  DCP 
are  Included  in  the  ADM  specification. 

2.3.3. 

2.3.3  Milestone  3  -  Develop  ADM  RFQ  Package 

2. 3. 3. I  DEFICIENCY 

o  Necessary  R&M  goals  and  adequate  monitoring  requirements  are  not  always 
Included  In  the  specification  and  contract. 

o  RiM  design  and  production  data  necessary  to  select  the  most  cost  effective 
design  is  not  always  requested. 

o  Readiness  and  life  cycle  cost  are  not  poart  of  the  evaluation  criteria. 

o  Development  of  the  most  cost  effective  readiness  design  approach 

capitalizes  on  the  latest  technologies  is  not  encouraged  via  prompt  R&M 
design  goal  method. 


1.3. 3. 2 


PROPOSED  CORRECTIVE  ACTION 

0  Insure  specific  RfiM  and  cost  criteria  are  included  in  Che  RFP  evaluation 
criteria. 

0  Insure  required  R&M  activities  and  date  are  procured  with  appropriate 
deliverv  schedules. 

o  Insure  delivery  of  specific  R&M  data  necessair^  for  evaluation  prior  to 

design  reviews  (i.e.,  schematics,  parts  lists,  thermal  analysis,  reliabilltv 
predictions,  cost  estiinates,  etc.) 

o  Insure  that  necessarv  funds  to  procure  the  required  R&M  activities,  both 
in  house  Navy  and  contractor  efforts,  and  the  data  are  specifically  ear¬ 
marked  for  RfiM  purposes. 

o  Request  multiple  R  design  data  along  with  complete  M  approach  for  each 
R  design, 

o  Req.test  complete  set  of  cost  data  for  each  R&M  resign  approach. 

o  Reonest  management  assurance  plan. 


o  Reauest  detailed  comments  on  critical  technology  issues, 
o  Request  status  on  tradeoff  methodologies  and  data  bases  used  to  select 
readiness  design  approach. 
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2.1.4 


Milestone  4  -  ADM  RFQ  Evaluation 


2. 3. 4.1  DEFICIENCY 

Primary  emphasis  is  presently  on  the  technical  aspects  of  the  contract,  with  contract 
price  driving  the  final  selection  in  case  of  more  than  one  technically  acceptable 
response. 

2. 3. 4.2  PROPOSED  CORRECTIVE  ACTION 

•  Utilize  R&M  critiera  as  major  factors  in  selecting  the  ADM  contractor. 

•  Utilize  Life  Cycle  Cost  for  selecting  the  final  R&M  design  parameters  for 
each  vendor  being  considered. 

•  Investigate  the  possibility  of  using  Life  Cycle  Cost  as  a  final  selection 
criteria,  rather  than  only  ADM  contract  price,  in  case  of  more  than  one 
technically  acceptable  response. 

2.3.  4.3  IMPLEMENTATION  REQUIREMENTS 

•  The  data  bases  required  for  milestone  1  are  required, 

•  Contractural  feasibility  study  for  using  LCC  in  lieu  of  ADM  contract  price. 


2.3.5  Milestone  5"  Design  Review 


2 , 3.  5. 1  DEFICIENCY 

The  data  necessary  to  accomplish  and  independent  Navy  evaluation  of  R&M  is  fre¬ 
quently  not  available  prior  to  the  design  review. 

2. 3. 5.2  PROPOSED  CORRECTIVE  ACTION 

•  Insure  the  use  of  standard  Data  Item  Descriptions  and  Contract  Data 
Requirement  Lists  for  the  R&M  data  requirements.  Require  NAVAIR 
approval  for  reduction  of  the  requirements  of  the  standard  data  package. 

•  Perform  an  independent  assessment  of  the  contractor's  R&M  activities 
prior  to  attending  the  design  reviews. 

•  Develop/evaluate  corrective  actions  as  required. 


2.3.  5.3  implementation  REQUIREMENTS 


istablish  procedures  with  AIR-03  for  reporting  anticipated  and  discovered 
L&M  problems.  Include  suggested  corrective  actions  and  anticipat^ 
indine  requirements.  A  candidate  format  is  presented  in  Section  VI. 


Develop  a  data  book  of  standard  work  accounts  for  common  reliability  & 
maintainability  problems  experienced  in  design. 
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2.3 . 5 . 6  Milestone  6  -  Transition  to  AIR-05 
2  J. 5. 6,1  DEFICIENCY 

Data  is  not  necessarily  presented  to  AIR-05  in  an  optimum  manner  for  improving  the 
Navy  contracting  activity  during  EDM. 

2.3,5. 6. 2  PROPOSED  CORRECTIVE  ACTION 

Insure  that  a  coherent  total  package  of  data  is  provided  to  AIR-05,  including: 

•  History  of  ADM  development 

•  Operational  Requirements 

•  Assumptions 

•  R&M  goals  selected,  with  rationale 

•  Progress  toward  reaching  goals 

•  Problems  encountered  and  status  of  action  items 

•  Recommendations  and  Conclusions 

•  Draft  EDM  Specification 

•  Draft  R&M  Development  Plan 

•  Draft  Test  Plan 

•  Draft  Incentive  Plan 

2.4  Proposed  AIR  03  Roadmap  -  A  stmmary  of  the  recommended  set  of  activities 

consistent  with  existing  readiness  assurance  milestones  and  designed  to  correct 
the  deficiencies  •  of  present  acquisition  methods  is  presented  in  Figure  " 
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.  Df>tannil»  rMdIM.  •ut.  of  •)»<•■».  ond/or  boeUou  to  <to  fU..!. 

,  D.t.nnl»  op.r.UOB.1  r«,uir.m.«.  tor  MalK^nobllW  ..  •■()■■  U..I  .od  (or 
fUUtbUlty. 

,  Dovolop  boot  poMlbl.  roprooeMUon  o(  the  op.r.Uon.1  loglotlci  lopport  onvlron- 
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•  GoaermM  th«  MTBF  requlretnenu  for  oportUoMi  equipment,  ind 

ti  vmrtoui  eusee  of  development.  Incorpor.ee  .peciflcUPD  MTBF  to 
OMt  MFHBF  decradetloD  fictora. 
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of^poneot*.  enviroumenui  control  iy.teme,  ILS.  pactapn*  imuIUUoo  etc. 

•  Highlight  crltio.l  RliM/lL3  lechnologte.  which  deelgn  U  dependent  on  to  meet 
It.  dealgn  gotl.. 

•  Generate  the  malntelneblllty  requirement,  for  the  operation  of  equlpmeuC 
Incorporate  the  beat  eeUmate  of  the  maintenance  and  .upport  poUcy  for  the 
operational  eqMlpmenu 

•  Develop  unit  coat  ind  operatlnf  co.t  ..tlmate.  guideUnea. 

•  Inaura  that  firm  R4M  guldanca  la  provided  to  the  Labormtorlee  via  the  DCP. 


e  taaure  that  the  foUowtng  elemeata  from  tha 
DCP  arn  Incorponted  in  the  specification, 

-  RAM  raqulreraerta  axJ  goal. 

-  deatVB  to  coal  objecti  rea 

.  pUmied  operattng  aiwl  loglaUea 
ottvlronmank 


Dealgn  Hevrewe 

I  Pvior  to  Design  Revlev^  _ _  ^  Attempt  reaohitton  of  action  item,  ganaratad  by  Indepandent  aaMasment. 

•  Generate  eugfeeted  corrective  actlooa  for  unretoWed  aetton  item,  and  «ibBlt 
to  project  managemeot. 

•  Perform  an  Independent  aasessmeot  of  the  maintainability  stUua. 

•  compare  the  independent  aaeee.ment  with  the  contr«:tora  predlcttwe  mul  tha 
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Compare  tha  independent  aaaessment  with  the  contrwtor.  predictive  and  the 
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ADM 


lEuiar*  Hut  U>*  followlD*  •ianiASU  from  th* 
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Rftll  r^qulremanU  goals 
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a  Inaura  that  raapouea  ara  sought  for  a  nominal 
HTBF  aqulpment  and  also  for  equiproetas 
with  hlgtiar  MTBP  and  lower  MTBF. 

•  Inaura  specific  RfcM  and  cost  criteria  are 
lAoludad  In  the  RFP  evaluaUon  ortterla. 

•  Inaura  required  RAM  activities  and  dau  ara 
procured  with  approprtate  delivery  schedules. 

a  Inaura  the  use  of  standard  Data  Item  Oe- 
scrtptlons  and  Contract  Oats  Requirement 
LlaU  for  the  RliM  daU  requlremenu.  Require 
NAVAIR  approval  tor  reducUon  of  the 
ra(|uiremaau  of  the  standard  data  package. 

a  Inaura  delivery  of  apeolflc  RI>M  dau  necessary 
for  evaluaUon  prior  to  design  reviews  (Is; 
sohemattos,  parU  lisU.  thermal  analysU, 
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dlotiaaa,  cost esUmaUs,  etc.) 


a  Insure  that  necetaarv’  fUnda  to  pfocur< 
required  RItM  actlvttlea  and  the  dau 
In  house  Navy  and  contractor  efforta 
spaeiflcally  earmarked  for  R&M  purp 

#  Insure  reaonancea  coauin  complete  n 
approach  and  coat  dau  for  each  rella) 
proach  c<maidared. 

a  Insure  reaponsea  are  sought  in  oriUc. 
technical  Issue. 

e  Insure  that  reaponsea  are  sought  to  i> 
methodologiet  and  daU  bases  used  to 
R&M  and  ILS  design  approaches. 

•  insure  that  raaponsea  are  sought  in  th 
meot  of  RItM  aohlevamaot  dinng  AD^’ 


loaura  th»t  reipoMc*  ire  loufht  for  •  eommel 
MTBF  equipment  ind  also  for  equipmemi 
with  hliher  MTBF  and  lower  MTBF. 

inaure  apeclflc  RtM  and  coat  criteria  are 
Included  In  the  RFP  evaluaUon  orlterta. 

[neure  required  RtM  activitlea  and  daU  are 
prooured  with  appropriate  delivery  achedilee. 

Inaure  the  uee  of  aUndard  Dau  Item  Oe- 
acrlpCtone  and  Contract  Data  Requirement 
Llete  for  the  R4M  datt  requlremenu.  Require 
HAVAIR  approval  tor  reducuon  of  the 
re<|Utreinoma  of  the  atandard  dau  package. 

ineure  delivery  of  apeclflc  RtM  dau  neceaaary 
for  evaluaUon  prior  to  dealgn  reviewa  (ie; 
soheraatles,  perU  llau.  thermal  analyaU, 
reliability  predlotlone,  mainuinablllty  pre> 
dlcttone,  ooat eetlmatea,  etc.! 


Inaure  that  neceaeary  tonda  to  procure  the 
required  RAM  actlvUlea  and  the  dau  for  both 
In  bouae  Navy  and  contractor  efforta  are 
specifically  earmarted  for  RAM  purposea. 

Inaure  reaonancea  conUln  complete  maintenance 
approach  and  coat  dau  for  each  reliability  ap¬ 
proach  oonaldered. 

Inaure  reaponaea  are  aougbt  in  critical  reaulu 
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Inaure  that  reaponaea  are  aought  In  all.  tradeoff 
metbodologlea  and  dau  baaes  used  to  develop  the 
RAM  and  ILS  dealgn  approachea. 

Inaure  that  reaponaea  are  aought  la  the  manage- 
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I'tillze  RAM  criteria  aa  major  factora  In  aelecUng  the  ADM  oootraetor. 

(nveatlgau  the  poaalbUlty  of  ualng  Ufa  Cycle  Coat  aa  a  final  aelacdoa  etlurla, 
rather  than  only  ADM  contract  price.  In  caae  of  more  than  one  technically 
acceptable  reaponee. 


Prior  to  Traneltlow  to  AIR-OS 

meure  that  a  coherent  total  package  of  daU  to  be  provided  to  AIR-dS  la  geoerated, 
inoludlnf; 

e  Hletory  of  ADM  development 

•  Operational  Requlremenu 

e  Aaeumptlooe 

e  RAM  goals  selected,  with  radonale 

e  Prograsa  toward  reaching  goala 

e  Pmblema  encountered  end  aUtua  of  action  lUma 

#  Recommendtttona  and  Coocluaiona 

e  Draft  EDM  ^eclfleatlon 

e  Draft  RAM  Development  Plan 

e  Draft  Teat  Plan 


EDM  Phase 


e  Trananeit  total  daU  package  (Final  Report)  to  AIR-05. 


Proposed  AIR-03  Roadma 
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SECTION  III 


AIR  03  READINESS  ASSURANCE  SYLLABUS 
FOR  NAVAIR  TECHNICAL  ADMINISTRATION 

3.1  General.  This  section  presents  a  syllabus  for  a  course  designed  to 
the  readiness  awareness  of  technological  administrators  in  the  AIR  03  community. 

The  resultant  syllabus  reflects  the  findings  of  a  readiness  technical 
team  which  surveyed  a  sampling  of  TSa  and  their  staff  prior  to  development  to 
assess  the  current  level  of  awareness. 

The  syllabus  achieves  increased  awareness  by  (a)  generating  a 
confidence  with  the  termonology  and  standard  assurance  methods,  (b)  demonstrating 
a  need  for  readiness  assurance  through  the  consequences  of  near  readiness  and 
the  emerging  challenges  of  a  smaller,  austere  and  distributed  Navy  and  (c)  pre¬ 
senting  an  effective  methodology  for  achieving  readiness  through  design. 

The  syllabus  motivates  the  use  of  increased  readiness  awareness  by  (a) 
illustrating  how  readiness  will  be  monitored  and  rewarded  within  the  AIR— 05 
management  system,  (b)  demonstrating  how  readiness  can  be  used  to  retain  on-going 
programs  and  market  new  ones  and  (c)  outlining  the  availability  and  use  of  data 
bases  within  the  NAVAIRSYSCOM  to  facilitate  the  use  of  the  new  readiness  assurance 
roadmap . 

The  syllabus  is  not  oriented  around  a  mathematical  treatment  on  the 
subject  of  ADM,  ILS  or  life  cycle  cost. 

Implementation  of  the  proposed  syllabus  will  require  research  on  each 
topic  delineated  as  well  as  packaging  into  both  presentation  and  booklet  formats. 
It  is  estimated  that  three  (3)  man-months  are  required  for  initial  preparation 
and  2.5  man-months  for  initial  implementation.  Annual  preparation  updates  and 
implementations  are  estimated  to  require  3  and  2.5  man-months  respectively. 

3.2  :  Recommended  Syllabus 

TITLE: 

SYLLABUS  OUTLINE  FOR  READINESS  AWARENESS 

OBJECTIVE: 

To  help  Technological  Administrators  within  NAVAIRSYSCOM  gain  an 
increased  understanding  for  the  need  for  readiness  awareness  and  its  vital 
importance  to  the  Navy  and  the  management  methods  and  controls  which  facilitate 
the  achievement  of  readiness  in  the  most  cost  effective  manner. 
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CONTENT: 


The  course  will  consider  key  dimensions  of  readiness  in  order  to 
increase  the  awareness  of  the  importance  of  readiness  and  identify 
potentials  for  further  work  and  study  by  the  participants. 

METHODS: 

The  course  can  be  implemental  in  either  of  two  ways: 

1.  A  one-day  workshop  utilizing  lecture,  simulation  and  discussion 

2.  A  printed  self-instruction  program  in  the  form  of  a  booklet. 

SALIENT  TOPICS: 

1.  What  is  readiness? 

2.  Why  is  readiness  assurance  important  in  the  development  of  NAVAIR 
programs? 

2.1  Present  Fleet  readiness  trends 

2.2  Changing  threat 

2.3  Changing  political  envoronment 

2.4  DoD  budget  considerations 

2.5  Capabilities  and  limitations  of  MIL  STD's  and  MIL  SPECs  for 
assuring  readiness 

2.6  Cost  Study  with  present  readiness  assurance  methods 

3.  A  roadmap  for  readiness  assurance  in  6. 2/6. 3/6. 4 

4.  Conceptual  phase  readiness  assurance  activities  amplified 

4.1  R&M/readlness  goals 

4.2  Operating /Logistics  Operating  Environment 

4.3  R&M/ILS  Design  Approach 

4.4  Critical  R&M/ILS  Technologies 

4.5  Contracting  for  maximum  industry  R&M  creativity 

4.6  Contracting  for  total  system  readiness 

4.7  Contract  awards  based  on  LCC  considerations 

4.8  Contracting  for  R&M  monitoring 

5.  ADM  phase  readiness  assurances  activities  amplified 

5.1  Continual  exchange  of  R&M/ILS  data 

5.2  Independent  R&M  assessment 

6.  How  readiness  can  be  used  to  advantage  in  marketing  6.2  and  6.3  programs 

7 .  How  to  initiate  critical  readiness  assurance  technologies 

8.  Summary  of  benefits  and  costs  of  implementation  of  the  new  readiness 
assurance  roadmap  and  how  to  budget  for  the  costs. 
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SECTION  IV 


AIR  03  READINESS  ASSURANCE  SYLLABUS  FOR 
PROGRAM  MANAGERS  AND  PROJECT  ENGINEERS 

4.1  General.  This  section  presents  a  syllabus  for  a  course  designed  to 
increase  the  readiness  awareness  of  project  engineers  within  NAVAIRSYSCOM 

and  the  Navy  field  activities. 

The  resultant  course  reflects  the  findings  of  a  readiness 
technical  team  which  surveyed  a  sampling  of  PEs  and  their  staff  prior  to 
development  to  assess  the  current  level  of  awareness. 

The  syllabus  achieves  increased  awareness  by  (a)  generating 
a  confidence  with  the  termonology  and  standard  assurance  methods,  (b) 
demonstrating  a  need  for  readiness  assurance  through  the  consequences 
of  poor  readiness  and  the  emerging  challenges  of  a  smaller,  auSture  and 
distributed  Navy  and  (c)  presenting  and  illustrating  an  effective 
methodology  for  achieving  readiness  through  design. 

The  syllabus  motivates  the  use  of  increased  readiness  awareness 
by  (a)  illustrating  how  readiness  will  be  monitored  and  reworded  by  the 
field  activity  managmeent,  the  AIR  03  sponsors,  and  Fleet  review  teams  at 
COMOPTEVFOR,  and  (b)  outlining  the  availability  and  use  of  data  bases 
and  technical  support  personnel  skilled  in  the  new  readiness  assurance 
roadmap  techniques . 

The  syllabus  is  not  oriented  around  a  mathematical  treatment 

on  the  subject  of  R&M,  ILS^  or  life  cycle  costs. 

The  primary  difference  between  the  PE  course  and  the  TA  course 
is  depth.  The  PE  course  demonstrates  more  of  the  day  to  day  mechanics 
of  the  implementation  of  the  readiness  assurance  roadmap  whereas  the  TA 
course  does  not- 

Implementation  of  the  proposed  syllabus  will  require  research 
on  each  topic  delineated  as  well  as  packaging  into  both  presentation  and 
booklet  formats.  It  is  estimated  that  6  man-months  are  required  for 
initial  preparation  and  2.5  for  initial  implementation  at  each  Navy 
laboratory.  Annual  preparation  updates  and  implementation  are  estimated 
to  require  3  and  2.5  man-months  respectively. 
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4 . 2  RECOMMENDED  SYLLABUS 


TITLE: 

SYLLABUS  OUTLINE  FOR  READINESS  AWARENESS 
OBJECTIVE: 

To  help  PMs  and  PEs  withia  NAVAIRSYSCOM  and  its  field  activities  to  become 
more  aware  of  the  importance  and  potential  for  incorporating  readiness  concerns 
in  the  conceptual  and  advanced  development  design  stages  through  the  contract- 
ural  processes  and  available  data  banks  and  methodologies. 


CONTENT: 

This  course  will  consider  key  dimensions  of  readiness  in  order  to  increase 
awareness  of  the  importance  of  readiness  and  identify  potentials  for  further 
work  and  study  by  the  participants. 


METHODS: 


This  course  will  utilize:  lectures,  class  notes,  and  discussions  to  present 
concepts;  and  problem-solving  simulations  to  engage  participants  in  the  use 
of  those  concepts  and  involve  them  in  relating  readiness  to  the  kind  of  issues 
they  face  on  their  jobs.  The  course  is  expected  to  take  three  8  hour  sessions 
to  complete. 


OVERVIEW: 

SESSION  TOPICS  CLASS  TIME  (Hrs) 


I  Orientation  and  Importance  of  Readiness.  4 

n  Readiness  Assurance  Methodology.  4 

III  Implementation  Requirements  for  Contractual  4 

Phase  Readiness  Assurance  Methods. 

IV  Implementation  Requirements  for  Assuring  8 

Readiness  via  the  ADM  Contractual  Process. 

V  Implementation  Requirements  for  Assuring  4 

Readiness  During  ADM. 
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24 


SESSION  1 


1.  Introduction  &  Orientation 

1.1  Definition  of  readiness 

1.2  Readiness  reporting 

1.3  Current  fleet  readiness  and  costs 

1.4  Readiness  data  banks 

1.5  Future  threat 

1.6  DoD  budget  levels 

1.7  Impact  of  acquisition  process  on  readiness 

2.  Team  competition  on  problem  solving  with  data  from  case  study  on  "Retrofit"  for 
Readiness  (e.g. ,  Airborne  Fire  Control  Radar  Set  -  AWG  10);  Given  this-equip- 
ment  with  its  known  readiness  problem,  develop  an  approach  and  suggest  a  correc 
tive  action  to  ease  the  problem. 

2. 1  Divide  group  into  teams. 

2.2  Each  team  prepares  a  solution 

2.3  Teams  report  and  critique  each  others'  work. 

2.4  Teams  compare  their  solutions  to  solution  actually  adopted  in  case  study. 

3.  Discuss  problem-solving  experience 

3. 1  Identification  of  principles  used  by  the  teams  in  developing  their  approaches 

3.2  Identification  of  applications  to  participants' jobs. 

4.  Present  and  discuss  material  relating  to: 

4. 1  Why  readiness  is  important  in  the  development  of  NAVAIR  programs. 

4.  2  Where  readiness  fits  in  the  DOD  Procurement  cycle. 

4.3  Whose  attention  is  required  for  readiness  development. 

5.  Identify  potentials  for  further  information  (papers,  courses,  and  related  issues) 

5. 1  Current  Fleet  Problems 

5.2  Current  AIR  03/05  Readiness  Programs 

5.3  Readiness  Data  Sources 


-36- 


SESSION  2 


1.  Capabilities  and  limitations  of  MIL  STDs  and  MIL  SPECs  for  readiness 
assurance 

2.  A  new  roadmap  for  readiness  assurance  in  6. 2/6. 3/6. 4 

3.  Conceptual  Phase  readiness  assurance  activities  amplified 

2.1  R&M/readlness  goals 

2.2  Operating/Logistics  environments 

2.3  R&M/ILS  design  approach 

2.4  Critical  R&M/ILS  Technologies 

2.5  Contracting  for  maximum  industry  R&M  creativity 

2.6  Contracting  for  total  system  readiness 

2.7  Contract  awards  bond  on  LCC  consideration 

2.8  Contracting  for  continual  R&M  monitoring 

4.  ADM  phase  readiness  assurance  activities  amplified 

3.1  Independent  R&M  assessment 

3.2  Implementing  R&M  design  changes 

5.  Navy  requirements  for  implementation 

5.1  Prediction  methods 

5 . 2  Data  bases 

5 . 3  Fund  analysis 


SESSION  3 


1.  Development  of  R&M/readlness  goals 

1. 1  R&M/readiness  defined 

1. 2  Differentiation  between  specification,  laboratory  values  and  fleet  values 

2.  Development  of  operational/logistics  environments 

2. 1  Task  force  mix 

2.2  Planned  utilization 

2. 3  Available  si^jport  platforms/bases 

3.  Development  of  R&M/CLS  Design  approach 

3. 1  R&MAls  technology  assessment 

3.2  Synthesis  of  alternatives 

3. 3  Evaluation  of  alter^-^H^es  In  terms  of  readiness,  cost,  turnaround  time. 
Space  requirements,  skill  level  requirements,  etc. 

4.  Critical  R&M^S  technologies 

4. 1  Readiness  parametric  analysis 

4.2  R&MAls  technology  advancement  studies 
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SESSION  4 


1.  Preparation  of  the  readiness  specification 

1. 1  R&M/readiness  goals  and  thresholds. 

1. 2  Design  to  cost  goals 

1. 3  Logistics/operating  environment 

1. 4  Applicable  MIL  STDs  and  SPECs  and  cost  implications 

2.  Preparation  of  the  RFQ  for  total  systems  readiness  responses 

2. 1  Rel  approach  format 

2. 2  Maintenance  approach  format 

2. 3  Maintenance  concept  format 

2.4  ICS  approach  format 

2. 5  Cost  elements 
2.  6  Sources  of  data 

2. 7  Tradeoff  methodologies 

3.  Preparation  of  the  RFQ  for  maximum  industry  R&M  creativity 

3. 1  Rar^e  of  R&M  within  SOA 

3. 2  Cost  vs  number  of  R&M  design  approaches 

4.  DIDS  required  for  effective  contract  monitor li^ 

4. 1  R&M  design  data  and  timing 

4.2  MO  for  affecting  proposed  dsigns 

5.  Evaluation  Criteria  for  ADM  awards 

5. 1  ADM  development  costs 

5.2  Readiness,  availability,  R&M 

5.3  LCC 

5. 4  Quality  of  management  plan 

5,  5  Credibility  of  readiness  inputs 

6.  Navy  requirements  for  implmentatlon 

6. 1  Assessment  methods 

6. 2  Data  bases 
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SESSION  5 


1.  Methodology  for  an  Independent  R&M  assessment 

1. 1  MIL  STD  217  B 

1.2  In  house  skills  required  for  implementation 

2.  Methodology  for  Impacting  the  design 

2. 1  Requirements  development 

2. 2  Benefits  analysis 

2. 3  Adjusting  planned  budgets 
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SECTION  V 


PAYOFF  3.  A  READINESS  ECONOMCTRIC  MODEL 
FOR  ADVANCED  TECHNOLOGIES 

5.1  OVERVIEW 

PAYOFF  3  U  a  computerized  model  deelgued  to  project  the  Me  cycle  cost 
savings  of  ezpected  reUablUty,  maintainability,  weight,  and  unit  coat  Improvements 
which  characterize  advanced  technology  designs  In  6. 2  or  6. 3.  The  model  Is  also  stiuc 
hired  to  permit  the  rapid  evaluation  of  a  varied  of  senslUvlty  analyses  such  as  the 
Impact  on  savtogs  due  to  reduoed/acoelerated  llindlng.  program  sttppage.  and/or 
partial  readiness  benefits. 

The  PAYOPP3  model  calculates  Me  cycle  savings  In  tmj  steps.  First  It  com¬ 
putes  the  Me  cycle  costs  assuming  no  changes  to  present  day  technology.  This  Is  the 

baseline.  » ‘ben  computes  the  Me  cycle  costs  with  the  new  technology.  The  Me  cycle 

savings  Is  the  difference  between  the  baseline  and  Improved  case. 

Life  cycle  costs  in  PAYOFF3  are  computed  by  summing  the  individual  Me 
cycle  costs  for  a  fined  set  of  existing  «ul  proposed  mrcraft  over  the  same  Me  cycle. 
Aircraft  In  the  set  are  all  Ukely  candidates  for  the  technology  being  evaluated. 

Life  cycle  cost  elements  In  PAYOPF3  Include  RJd)  coets  to  develop  the  new 
technology,  acquisition  costs  to  Install  the  new  technology,  initial  outfitting  costs  (to 
pipeline  spares,  special  support  equipment,  publications,  etc)  and  operating  costs. 

There  are  four  primary  Inputs  which  oontiol  the  amount  of  savings  projected  by 
PAYOPF3.  They  are  1)  the  degree  of  R&M.  unit  cost,  and  weight  Improvements,  2)  the 
timing  of  the  ADM/EDM  windows  on  each  weapon  system  application  relative  to  the 
completion  of  the  technology,  3)  the  quantity  of  aircraft  receiving  the  technology,  and 
4)  the  technology  funding  profile  which  controls  the  rate  of  benefit  growth. 

Outputs  from  PAYOPF3  are  both  tabular  and  graphic.  Cost  tables  are  generated 
tor  baseline  and  new  technology  cases  by  Individual  aircraft  and  Ufe  cycle  year.  A  graph 
of  total  costs  by  year  for  both  baseUne  and  new  tochnology  Is  also  generated 
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PAYOFFS  is  written  in  FORTRAN  and  is  currently  operational  on  NADC’s 
CDC  6600.  It  automatically  interfaces  with  NADC’s  Fleet  readiness  data  bank  for 
realistic  cost  and  R&M  factors  which  are  functionally  equivalent  to  the  advanced  tech¬ 
nology  being  evaluated.  The  data  bank  is  updated  annually  through  an  AIRTASK  with 
Air  4105. 


5.2  INPUTS 


•  Future  Aircraft  Procurement 


Aircraft 
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150 

150 

70 

30 
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mMMm 
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1 

1 

1 

1 

1 

Baseline  Aircraft  Properties 

A.  Physical 

1.  empty  wt 

2.  ratio  of  subsystem  wt  to  total 

3.  fuel  consumption  (barrels/hour). 

B.  Acquisition  Costs 

1.  unit  technology  cost 

2.  slope  for  airframe  $/lb  learning  curve 

3.  offset  for  airframe  $/lb  learning  curve 

4.  slope  for  unit  cost  curve 

5.  offset  for  unit  cost  curve 

C.  Operational 

1.  monthly  utilization 
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D.  R&M 

1.  MTBMA 


2. 

MMH/MA  @  0  Level 

(Ki) 

3. 

MMH/MA  @  I  Level 

(K2) 

4. 

MMH/repalr  @  D  Level 

(Ks) 

5. 

0  Level  MA/total  MAs 

(K4) 

6. 

0  Level  repairs/total  MAs 

(Kg) 

7. 

I  Level  MAs/total  MAs 

(Ke) 

8. 

I  Level  repairs/total  MAs 

(K7) 

9. 

I  Level  attritions/total  MAs 

(Ks) 

10. 

NARF  repairs/total  MAs 

(Kg) 

11. 

Commercial  repairs/total  MAs 

(Kio) 

12. 

Depot  surveys/total  MAs 

(Kn) 

Cost  Factors 

1. 

Matl  $/0  Level  repair 

(Cl) 

2. 

Matl  $/I  Level  repairs 

(Cg) 

3. 

Matl  $/I  Level  attrition 

(C3) 

4. 

Matl  $/NARF  repair 

(C4) 

5. 

Matl  $/D  Level  survey 

(C5) 

6. 

Matl  $/commercial  repair 

(Cg) 

7. 

Labor  $  per  direct  hour  for  O&I 
maintenance 

(C7) 

8. 

Labor  $  per  direct  hour  for  D 
maintenance 

(Cg) 

9. 

Labor  $  per  direct  hour  for 
commercial  maintenance 
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%  CHANGE  -  FROM  BASELINE 


•  TECHNOLOGY  GROWTH  FACTORS 


•  FUNDING  PROFILES 

A,  ADM  R&O 
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5.3  OUTPUTS 


•  Baseline  Life  Cycle  Costs 
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•  Technology  Gro^vth  Life  Cycle  Costs 
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DOLLARS  -  THOUSANDS 


Overall  savings  graph 


5.4  EQUATIONS 

•  LCC  =  R&D  +  Acquisition  +  lOL  +  Operating 

•  Acquisition  =  unit  price  x  quantily  x  Learning  Factor 

•  lOL  =  GSE  +  training  +  pipeline  spares 


GSE  +  training  (ii^t) 

pipoline  spares  —  site  +  depot 

site  spares  = 

(daily  removal  rate  x  3) 

all 

sites 

( 

depot  spares  b|  Lmd 

(daily  BCM  rate  x  120) 

1  all' 

sites 
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Operating  =  maintenance  +  POL 

n  years 

12X  utilization  x 

•  maintenance  =  mTBMA  ” 


(AC)j 

K.  K 

\  4  4 


Vs  •  ii.  *  * -12. ,  ^  ^  .-II 

K,  "s  "s  "s  ‘'ll  •'lO 


ja  years 


subsystem  net  ^  ^  utiUzation  x  E 

•  total  wt  hr 


barrel 


Notes 


1.  See  input  section  for  an  explanation  of  the  and  K^. 
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5.5  HYDRAULIC  TECHNOLOGY  APPLICATION 


5.5.1  Objective  -  To  investigate  the  cost  savings  for  three  different 
hydraulics  technologh  programs  for  a  set  of  weapons  systems  over  the 
next  25  years. 

5.5.2  Approach  -  A  baseline  case  consisting  of  no  advance  in  technology 
and  three  cases  investigating  the  sensitivy  to  various  level  of 
improvement  and  funding  rates  were  evaluated  using  the  PAYOFF  3  model. 
The  weapons  systems  considered  are  the  A- 18,  AHX,  CVHSL,  F-18,  HXH, 

HXM,  KAX,  KCX,  OVX,  VAMX,  VPX,  VSTOL-84,  VSTOL  A  and  VSTOL  B. 


5.5.3  Summary  of  Results 


Baseline 

Case  I 

Case  II 

Case  ni 

Life  Cycle  Cost 
($  FY-75) 

$1023  M 

$  849  M 

$1049  M 

$1198  M 

R&D  Funding 

NONE 

$17. 3  M 

$21.5 

..  . - . 

$38.4 

System 

Weight 

No  Change 

-  50% 

-50% 

-  50% 

MTBMA 

No  Change 

+  20% 

_40% 

_40% 

MMH/MA 

No  Change 

-  10% 

-  20% 

-  20 

BCM  Rate 

No  Change 

-  5% 

-  10% 

-  10 
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DOLLARS-  Millions 


5.5.4 


5.5.4. 1  Per  Year 


YEARS  INTO  PROGRAM 


5. 5. 4. 2 


Cumulative 

2000r  __ 
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200  “ 


BASELINE  CASE  (Cumulativt  Total  Dollara) 


0 


%  CHANGE  FROM  BASELINE 


-5 


5. 5. 5. 3 


LCC  Profile 


5.5.5. 3.1  Cost  per  year 


YEARS  INTO  PROORAM 
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5. 5. 6. 4 


Cost  Summary 


TOTAL  R&O 
funding 

lifecycle 

COST 

NET 

SAVINGS 

S21.5M 

$1049 M 

.$29M 

-52 


%  CHANGE  FROM  BASELINE 


5.5.6  Case  II  -  Description 

5.5.6. 1  o  HYDRAULICS  TECHNOLOGY  GROWTH  FACTORS  -  CASE  11 


5. 5. 6. 2  o  FUNDING  PROFILE  -  CASE  11 


FY 

79 

80 

81 

82 

83 

84 

85 

$M 

.5 

.5 

3.5 

6.0 

4.5 

4.5 

2.0 
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DOLLARS-  millions 


5.5. 6.3 


LCC  Profile 


5. 5. 6. 3.1  Cost  Per  Year 


5. 5. 6. 3. 2  Cumulative  Cost  Per  Year 


-5 
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5. 5. 7. 3 


LCC  Profile 


5. 5. 7. 3.1  Cost  Per  Year 


YEARS  INTO  i>ROQRAM 

‘5.5.7. 3.2  Cumulative  Cost  Per  Year 


-57- 


5. 5. 7. 4  Cost  Sunnnary 


TOTAL  R&D 
FUNDING 

lifecycle 

COST 

NET 

SAVINGS 

S38.4  M 

$1198M 

-$175M 
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5.6 


MODULAR  RADAR  APPLICATION 


^  g  Ob  1  active  -•  Investigate  the  cost  savings  for  four  different  programs 

for  a  set  of  weapon  systems  over  the  next  25  years. 

5.6.2  Approach  -  A  baseline  case  consisting  of  no  advance  in  technology 
and  four  cases  investigating  the  sensitivity  to  various  levels  of  improvement 
and  funding  rates  were  evaluated  using  the  PAYOFF  3^K>de.  — 

The  weapon  systems  considered  are  the  A“18,  VAMX,  and  VSTOL  B. 


5.6.3  Summary  of  Results 


Baseline 

Case  I 

Case  II 

Case  III 

Case  IV 

Life  Cycle 

Cost  ($FY-75) 

$615. 3  M 

$239. 6  M 

$381. 8  M 

$307. 4  M 

$440. 1  M 

R&D  Funding 

NONE 

$  28. 7  M 

$  28.  7  M 

$  28.  7  M 

$  28.  7  M 

Sys  Weight 

No  Change 

-  50% 

-50% 

-  25% 

-  25% 

MTBMA 

No  Change 

+100% 

+100% 

+  50% 

+  50% 

mmhAia. 

No  Change 

-  50% 

-  50% 

-  25% 

-  25% 

BCM  Rate 

No  Change 

- 

- 

- 

- 
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5.6.4 


Baseline  Costs 


5. 6. 4.1  Per  Year 


5. 6. 4. 2  Cumulative 
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%  CHANGE  FROM  BASELINE 


5.6.5 


Case  1  -  Description 
5.6.5. 1  o  MODULAR  RADAR  GROWTH  FACTORS  -  CASE  1 


5. 6. 5. 2  o  R&D  FUHDING  PROFILE  -  CASE  1 


5. 6. 5. 3 


LCC  Profile 


t  2  3  4  8  e  1  8  9  10  11  12  13  14  18  16  17  18  19  20  21  22  23  24  25 

YEARS  INTO  PROGRAM 
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6.6.4  Cost  Summary 


TOTAL  R&D 
FUNDING 

LIFE  CYCLE 
COST 

NET 

SAVINGS 

$28.7  M 

$239.6  M 

$378.7  M 
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%  CHANGE  FROM  BASELINE 


5.6.6 


5. 6. 6.1  o  MODULAR  RADAR  GROWTH  FACTORS  -  CASEll 


5. 6. 6. 2  o  FUNDING  PROFILE  -  CASE  11 


FY 

77 

78 

79 

80 

SM 

9.5 

3.2 

2.0 

mm 

Q 

Q 

IB 
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DOLUARS-  MILLIONS 


%  CHANGE  FROM  BASELINE 


5.6.7 


Cast  11  -  Description 

o  MODUMLAR  RADAR  GROWTH  FACTORS  -  CASE  111 


5. 6. 7. 2  o  FUNDING  PROFILE  -  CASE  111 


FY 

77 

78 

79 

80 

$M 

12.7 

■w 

mm 

— 

la 

5. 6. 7. 4  Cost  Summary 


TOTAL  R&D 
FUNDING 

LIFE  CYCLE 
COST 

NET 

SAVINGS 

$287  M 

$307.4  M 

$307.9  M 

%  CHANGE  FROM  BASELINE 


5.6.8 


Cost  IV  -  Description 
5.6. 8.1  o  MODULAR  RADAR  GROWTH  FACTORS  -  CASE  IV 


5. 6. 8. 2  o  FUNDING  PROFILE  -  CASE  IV 


FY 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86  1 

$M 

9.5 

3.2 

2.0 

2.0 

m 

El 

Bi 
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DOLLARS  -  MILLION S 


5. 6. 8. 3 


5.6. 8. 4 


Cost  Summary 


TOTAL  R&D 
FUNDING 

LIFECYCLE 

COST 

NET 

SAVINGS 

$28.7  M 

$440.1  M 

$175.2  M 
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5.7 


RING  LASER  GYRO  APPLICATION 


5.7.1  Objective  -  To  investigate  the  cost  savings  for  four  different 
ring  laser  gyro  technology  programs  for  a  set  of  weapons  systems 
over  the  next  25  years. 

5.7.2  Approach  -  A  baseline  case  consisting  of  no  advance  in  technology 
and  four  cases  investigating  the  snesitivlty  to  various  levels  of 
improvements  and  funding  rates  were  evaluated  using  the  PAYOFF  3 
model. 

The  Weapons  systems  considered  are  the  A— 18,  AHX,  CUHSK,  F-18,  HXH, 
HSM,  KAX,  KCX,  OVX,  VAMX,  VPX,  VSTOL-84,VSTOL  A  and  VSTOL  B. 

5.7.3  Summary  of  Results 


Baseline 

Case  I 

Case  11 

Case  ni 

Case  IV 

Life  Cycle  Cost 

$620. 9  M 

$235. 3  M 

$330. 8  M 

$285. 6  M 

$389. 4M 

R&D  Funding 

NONE 

$  24. 6  M 

$  24. 6  M 

$  24.6  M 

$  24. 6  M 

Sys  Wei^t 

No  Change 

-  50% 

-  50% 

-  25% 

-  25% 

MTBMA 

No  Change 

+900% 

+900% 

+450% 

+450% 

MMH/MA  (I) 

No  Change 

+150% 

+150% 

+150% 

+150% 

MMHAIA  (O) 

No  Change 

-  50% 

-  50% 

-  25% 

-  25% 

BCM  Rate 

No  Change 

+  50% 

+  50% 

+100% 

+100% 
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DOLLARS-  MILLIONS  ^  DOLLARS-  MILLIONS 


5.7.4 


Baseline  Costs 


5.7.4. 1  Per  Year 


NGE  FROM  BASELIN 


5- 


5. 7. 5. 4 


Cost  Summary 


* 


TOTAL  R&D 
FUNDING 

LIFE  CYCLE 
COST 

NET 

SAVINGS 

$24.6  M 

$235.3  M 

$385.6  M 
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%  CHANGE  FROM  BASELINE 


5.7.6  Case  11  -  Description 

5. 7.6.1  o  RING  LASER  GYRO  GROWTH  FACTORS  -  CASE  11 


5. 7. 6. 2  o  FUNDING  PROFILE  -  CASE  11 


FY 

77 

78 

79 

80 

81 

82 

83 

84 

85 

87 

$M 

7.8 

2.2 

2.2 

2.2 

2.0 

1.8 

1.8 

.6 

D 

.6 
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DOLLARS -THOUSANDS  n>  DOLLARS 


5. 7. 6. 3 


LCC  Profile 


5. 7. 6. 3.1  Cost  Per  Year 


YEARS  INTO  PROGRAM 

Cumulative  Costs 


1  2  3  4  B  8  7  a  a  to  11  13  13  14  IB  IB  17  18  10  30  21  22  23  34  2S 
YEARS  INTO  PROGRAM 
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total  r&d 

FUNDING 


life  cycle  net 
COST  SAVINGS 


$24.6  M 


$330.8  M 


$290.1  M 


%  CHANGE  FROM  BASELINE 


5.7.7 


Case  111  -  Description 


5. 7. 7.1  o  RING  LASER  GYRO  GROWTH  FACTORS  CASE  111 


5.7. 7.2  o  FUNDING  PROFILE  -  CASE  111 


FY 

77 

78 

79 

80 

81 

82 

SM 

10 

4.5 

4.0 

3.5 

1.3 

1.3 
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5. 7. 7. 4 


Cost  Summary 


TOTAL  R&D 
FUNDING 

life  cycle 

COST 

NET 

SAVINGS 

S24.6  M 

$285.6  M 

$335.3  M 
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%  CHANGE  FROM  BASELINE 


5.7.8 


5. 7. 8.1  o  RING  LASER  GYRO  GROWTH  FACTORS  CASE  -  IV 


5. 7. 8. 2  o  FUNDING  PROFILE  -  CASE  11 


SECTION  VI 


AIR  03  READINESS  ASSURANCE  ROADMAP 
APPLICATIONS 


6.1  General.  This  section  summarizes  the  results  of  attempting  to 
implement  the  readiness  assurance  roadmap  developed  in  Section  2  for  two 
on-going  AIR  03  ADM  programs  -  ASCL  and  JTIDS.  For  the  ADM  stage  of 
development,  roadmap  implenentation  requires  an  independent  government 
assessment  and  correction  actions.  In  both  test  cases  the  independent 
assessment  was  being  attempted  without  the  benefit  of  performing  any 
conceptual  design  work  or  establishing  the  goals  and  monitoring  framework 
for  the  contract.  The  purpose  of  the  exercise  was  to  (a)  establish  a 
format  for  presenting  results  and  conclusions  to  AIR  03,  (b)  uncover 
design  deficiencies,  and  (c)  determine  implementation  requirements  for 
future  indeavors.  The  technical  base  supporting  the  effort  consisted  of  a 
single  electrical  engineer  per  program  each  familiar  with  the  functional 
performance  of  the  system  of  interest  as  well  as  an  in  depth  understanding 
of  the  disciplines  of  R&M,  ILS  and  LCC.  Neither  engineer  had  access  to 
any  automated  R&M/ILS/LCC  methods.  Each  was  given  a  total  of  2  months  to 
acquire  the  appropriate  background  on  each  particular  system  and 
implement  the  roadmap  concept. 

6.2  of  Results  Based  on  ASCL  and  JTIDS  Evaluation.  A  svimmary  of 
attempting  to  implement  the  roadmap  for  ASCL  and  JTIDS  is  presented  in 
Figure  9  and  10  raspectl /  iiv. 

In  general  the  technical  base  employed  foimd  it  difficult  to 
independently  assess  the  readiness  status  relative  to  the  contract  for  one 
or  more  of  the  follows  reasons: 

a.  Contract  specifications  were  Incomplete  in  the  areas  of  R&H  and 
no  justification  could  be  found  connecting  the  four  R&M  parameters 
to  an  operational  need.  Therefore  if  the  design  could  be  assessed 
it  would  be  impossible  to  establish  whether  they  were  deficient 
from  a  Navy  point  of  view. 
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FIGURE  10 
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TABLE  1  FLEET/SPECIFICATION  RELIABILITY  RATIOS  FOR  SELECTED  AVIONICS  EQUIPMENT 
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ARR-52 
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ARN-84 

ARN-21 

ASQ-19 

APX-76 

APX-72 

ASW-25 

ARR-69 

ARA-50 

APX-64 
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*  TEST  DATA  NOT  RELATABLE  TO  MIL-STD-781 


TABLE  1.  FLEET/SPEGIFICATION  RELIABILITY  RATIOS  FOR  SELECTED  AVIONICS  EQUIPMENT  (cont'd) 


CO 

I 

QQ 


FLEET  MPHBF/ 
SPEC  MTBF 

.286 

.  100  1 

.450 
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o 
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.300 
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L 


Surveillance 

Helicopter 


b.  The  technical  monitoring  framework  was  incomplete.  As  a  result 
the  Navy's  engineers  were  not  allowed  access  to  the  approrpiate 
engineering  drawings  without  incurring  a  cost  to  the  program. 

Under  these  conditions,  it  was  not  possible  to  assess  the  R&M 
status  of  either  ASCL  or  JTIDS  ADM  design.  The  vendors  did 
however  provide  a  summary  of  the  results  of  their  own  R&M 
assessment  at  the  organizational  level.  Neither  vendor  has 
made  an  "I"  level  maintainability  assessment.  In  spite  of  the 
inability  to  fully  implement  the  roadmap  for  either  the  ASCL  or 
JITIDS  equipments,  several  conclusions  were  established  which 
made  the  effort  worthwhile: 

a.  The  Navy  can  realize  tremendous  savings  in  development 
and  maintenance  money  by  attempting  to  establish  their 
R&M  requirements  based  on  an  operational  need.  Without 
hard  argurments  the  vendor  is  given  the  opportunity  to 
establish  them  in  his  best  interests  which  could  result 
in  considerable  expense  to  the  government.  In  the  area 
of  reliability  the  vendor  can  sell  a  lengthy  test  program 
to  demonstrate  a  high  reliability  in  a  laboratory  which 
may  not  be  needed. 

b.  The  Navy  can  realize  a  tremendous  savings  in  development 
money  by  providing  a  facsimile  operational  and  intergation 
environment  for  testing.  Without  the  true  environmental 
profiles  the  vendors  generally  select  a  weak  facsimile 
because  it  enables  him  to  demonstrate  a  higher  reliability 
with  a  high  degree  of  confidence.  To  the  Navy  a  weak 
facsimile  translates  directly  into  a  large  variance  between 
factory  and  field  reliability.  This  results  in  lower  than 
expected  readiness  due  to  a  higher  failure  rate,  increased 
down  times  and  longer  queries  in  the  IMS  for  a  higher  than 
expected  work  load.  Maintenance  costs  are  also  higher  than 
expected  for  repair  and  pipeline  sizes. 
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c.  The  Navy  can  realize  a  tremendous  savings  in  maintenance 
dollars  by  considering  a  complete  maintenance  concept 
in  ADM  and  not  just  the  organizational  level  maintenance  concepts. 
Without  any  specifications  for  "I"  level  maintainability, 

Che  ADM  design  is  not  optimized  for  test  points  which  are 
necessary  for  ATE  type  testing  in  the  IMA.  As  a  result 
lengthy  test  programs  and  complex  interface  devices  are 
rec^uired  to  compensate  for  a  lack  of  adecjuate  test  points 
for  isolation  below  the  WRA. 

Based  on  (a)  and  (b)  above  it  can  be  considered  that  a  partial 
impact  can  be  made  on  a  program  already  underway  in  ADM  by  means  of 
thr  readiness  assurance  roadmap.  The  level  of  effort  required  is 
greater  than  two  man  months  in  order  to  develop  the  R&M  goals  and 

establish  the  operating  and  integration  stress  levels  for  testing. 

In  general  however  the  fullest  readiness  assurance  impact  can  not  be 
achieved  without  either  (a)  active  participation  prior  to  the  ADM 
period  (i.e.,  during  concept  formulation  and  ADM  contract  negotations) , 
or  (b)  significant  monies  are  made  available  for  obtaining  the  necessary 
documentation  for  in-depth  independent  assessment  and  the  corresponding 
corrective  action  efforts  necessary  to  bring  a  design  into  specification 
or  modify  the  original  specifications. 
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